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Abstract — We present lower bounds on the minimum pseu- 
docodeword effective Euclidean distance (or minimum "pseu- 
dodistance") for coded modulation systems using linear codes 
with g-ary phase-shift keying (PSK) modulation over the ad- 
ditive white Gaussian noise (AWGN) channel. These bounds 
apply to both binary and nonbinary coded modulation systems 
which use direct modulation mapping of coded symbols. The 
minimum pseudodistance may serve as a first-order measure 
of error-correcting performance for both linear-programming 
and message-passing based receivers. In the case of a linear- 
programming based receiver, the minimum pseudodistance may 
be used to form an exact bound on the codeword error rate of 
the system. 

Keywords: Iterative decoding, linear-programming decoding, 
factor graph, graph cover, pseudocodewords, pseudodistance. 

I. Introduction 

A. Background 

In classical coding theory, maximum-likelihood (ML) de- 
coding of a signal-space code leads to a nearest-neighbour 
decision rule in the signal space. For this reason, the minimum 
Euclidean distance between modulated codewords (signal 
points) of a signal-space code is used as a first-order measure 
of its error-correcting performance under ML decoding. In the 
case of binary modulation, the minimum Hamming distance of 
the underlying code may be substituted, since in this case the 
Hamming distance is proportional to the squared Euclidean 
distance. 

Recently, low-density parity check (LDPC) codes HI have 
attracted much interest due to their practical efficiency. In 
particular, it was shown that several families of LDPC codes 
can attain the capacity of various channels, when decoded 
by iterative message passing (MP) algorithms (for instance 
see 0, El, §]). 

The MP decoding algorithm operates locally on the Tanner 
graph, a graph which represents the parity-check matrix. The 
notion of computation tree pseudocodewords was introduced 
in in order to adequately explain the limitations of MP de- 
coding of binary LDPC codes. Computation tree pseudocode- 
words are closely related to graph-cover pseudocodewords. 



The latter were extensively studied in O, Q, (SI and @. 
The graph-cover pseudocodewords lie inside a region called 
the fundamental cone (see O, 0). The set of graph-cover 
pseudocodewords were shown to be equivalent to the set 
of linear-programming (LP) pseudocodewords for the cases 
of binary iflOl . ifTTI and nonbinary coded modulation sys- 
tems lfl2l . fl3l . In both binary and nonbinary cases, necessary 
and sufficient conditions for codeword error under linear 
programming (LP) decoding could be expressed is terms of 
these LP pseudocodewords, assuming transmission of the all- 
zero codeword (02, 03). 

In 031, the pseudocodeword effective Euclidean distance, 
or pseudodistance, is associated with any pseudocodeword. 
This concept of pseudodistance was shown in |[T4ll to play 
an analagous role to that of the signal Euclidean distance 
in ML decoding. The minimum pseudodistance is defined as 
the minimum over all pseudodistances of pseudocodewords; 
this may be taken as a first-order measure of decoder error- 
correcting performance for LP or MP decoding. In (9), it 
was shown that bounds could be obtained on the minimum 
pseudoweight of a binary linear code, these bounds being 
expressed in terms of parameters of the parity-check matrix 
of the code. 

In this work, we extend the results in [9] to the nonbinary 
case. In particular, we show that bounds on the minimum 
pseudodistance can be obtained for the case of nonbinary 
coding and modulation, which are generalizations of the 
bounds on pseudoweight in [ 9 ] for the case of binary coding 
and modulation. Generally, the techniques are based on the 
techniques therein, although some additional ideas are used. 

B. Basic Definitions 

We consider codes over finite rings (this includes codes 
over finite fields, but may be more general). Denote by SH 
a ring with q elements, by its additive identity, and let 
= [H\{0}. Let C be a linear [n, k] code with parity-check 
matrix Ti over 9\ (we assume that *K is quasi-Frobenius, which 
implies that the parity-check matrix exists). The parity check 
matrix H has m> n — k rows. 



Denote the set of column indices and the set of row 
indices of U by X = {1, 2, • • • , n} and J = {1,2, • • • , m}, 
respectively. We use notation Hj for the j-th row of H, and 
lj for the support of Hj. 

Given any c S Pt™, we say that parity check j 6 J is 
satisfied by c if and only if 

X '•< ' tt-< 11 • (!) 

Also, we say that the vector c is a codeword of C, writing 
c G C, if and only if all parity checks j 6 J are satisfied by 
c. 

Let the graph Q = (V, £) be the Tanner graph of C 
associated with the parity-check matrix 7i. This graph has 
vertex set V = {ui,u 2 , ■ ■ ■ , u n }L){vi,V2, ■ ■ ■ , v m }, and there 
is an edge between it; and Vj if and only if Ttj,i 7^ 0. 
This edge is labelled with the value Tij.i- We denote by 
Af(v) the set of neighbors of a vertex v G V. For a word 
c = (ci,C2,-- - ,c„) G £H n , we associate the value Cj with 
variable vertex Uj for each z G X. It may be easily seen that the 
Tanner graph provides a graphical means of checking whether 
each parity-check j 6 J is satisfied, and hence whether the 
vector c is a codeword of C. 

Definition 1.1: ((6]) A graph Q = (V, £ ) is a finite cover 
of the graph Q = (V, £) if there exists a mapping II : V — > V 
which is a graph homomorphism (II takes adjacent vertices of 
Q to adjacent vertices of Q), such that for every vertex v G Q 
and every -0 G n _1 (t>), the neighborhood M(v) of v (including 
edge labels) is mapped bijectively to AT(v). 

Definition 1.2: (|6|) A cover of the graph Q is called an 
M -cover, where M is a positive integer, if |n _1 (?;)| = M for 
every vertex v G V. 

Fix some positive integer M. Let Q — (V,f) be an 
M -cover of the Tanner graph Q = (V,£) of the code C 
associated with the parity-check matrix fi. Denote the vertices 
in the sets and LT — 1 ) by {14 i, u^, ■ • • , u^m} an d 

Wj,2) ' ' ' i ^',m}> respectively, where i£l and j G J". 

Consider the linear code C of length M n over D\, defined 
by the Mm x Mn parity-check matrix H. For 1 < i* , j* < M 
andi elj'e J", we let i' = (i-l)M+i*,/ = (j-l)M+j*, 
and 

nj '^' \ otherwise ' K ' 

Then, any vector p G C has the form 

P = (Pl,l,Pl,2,--- ,Pl,M,P2,l,P2,2, 

• ' • >P2,M) ' ' ' >Pn,l,Pn,2i ' ' ' ,Pn,Ai) ■ 

We associate the value p,^ G SH with the vertex in ^ 
(iel, £ = 1, 2, • • • , M). It may be seen that (? is the Tanner 
graph of the code C associated with the parity-check matrix 
H. 

The word p G C as above is called a graph-cover 
pseudocodeword of the code C We also define the n x q 
pseudocodeword matrix corresponding to p by 

V = (m^) 



where 

m!? ] = |{£ G {1, 2, • • • , M} : p M = a}\ > , 

for i E X, a € 9i. We then define the normalized pseudocode- 
word matrix corresponding to p by 

Vo = (if >) 

where = m\ /M for every j G X, a G fH. 

In [12 1, [15 1, another set of pseudocodewords, called linear- 
programming pseudocodewords, was defined. These LP pseu- 
docodewords, which also admit a matrix representation, were 
shown to be directly linked to codeword error events in 
LP decoding. It was also shown in [12|, [15| that the two 
pseudocodeword concepts are equivalent, i.e. there exists an 
LP pseudocodeword with a particular pseudocodeword matrix 
if and only if there exists a graph-cover pseudocodeword 
having the same pseudocodeword matrix. 

It was shown in |[T2l and |[T6l that for the case of q-ary 
PSK transmission over AWGN under LP or MP decoding, 
the codeword error rate performance is independent of the 
transmitted codeword under the following conditions. First, SH 
under addition is a cyclic group. If we let (3 be a generator 
in $K then we may write = {0, (3, 2(3, ■ ■ ■ ,(q— 1)(3} where 
k(3 = (3+- ■ -+P (k > terms in sum). Second, the modulation 
mapping is the 'natural' mapping 

M(fc/3)=exp(i^) , (3 ) 

where 1 = y— 1. We assume in this work that these conditions 
hold; hence in the sequel, we adopt the simpler notation fi(k) 

for/f«, k = 0,l,--- ,q-l. 

II. Bounds on the Pseudodistance of Individual 
Pseudocodewords 

In ifTTll . for the case of binary coding and binary modulation, 
the set of pseudocodewords was used to characterize the error 
correction capability of the system under LP decoding. This 
was extended to the case of nonbinary coding and modulation 
in lfl2l . In |[l"4]l . it was observed that with each pseudocode- 
word p may be associated a point in the signal space; these 
signal points then play a role in LP decoding analagous to that 
of the modulated codewords in ML decoding. In particular, 
we may associate with each pseudocodeword an effective 
Euclidean distance from the modulated all-zero codeword, or 
pseudodistance, d e s(p) (pseudodistance with respect to the all- 
zero codeword is sufficient assuming the symmetry condition 
above). Then, assuming LP decoding, the event E(p) = "on 
transmission of the all-zero codeword, there is a codeword 
error due to pseudocodeword p" has probability 

P(E(P)) = Q (^) (4) 

(where a 1 is the noise variance per dimension, and Q(x) = 
j- J exp(— t 2 /2)dt denotes the Gaussian Q-function) and 
thus the probability of codeword error is equal to P(\J E(p)) 



where the union is over the set of all pseudocodewords p 
(equation (O was stated in T\M for the case of MP decoding 
and computation tree pseudocodewords). Therefore the min- 
imum pseudodistance d m ; n = mm p {d e s(p)} may be taken 
as a first-order measure of error-correcting performance of 
the coded modulation system. For the case of MP decoding 
and graph-cover pseudocodewords, may be taken as an 
approximation. Also, for the case of binary coding and mod- 
ulation, the pseudocodeword effective Hamming weight (or 
"pseudoweight") may be defined by w e s(p) = d% s (p)/4 by 
analogy with the case of classical ML decoding [14|. 

It was shown in ifTTl that for the case of q-ary PSK 
modulation over AWGN, the squared pseudodistance between 
the all-zero codeword and the pseudocodeword p is given by 



where 



and 



9-1 



5 = 2 E i-E^( fc )- cos 



iei 



k=0 



(t) 



(5) 



(6) 



i6l \ k=Q 



2 E fi(k)fi(e) ■ cos 

k<i 
k,ie{0,...,q-l} 

2g/ i (fc).cos(^)+l > ) 
fc=0 \ 1 / J 



2ir(k - £) 



(7) 



By rearrangement of the expression in we have 

iez V k=Q \ y / / 



fq-X 



2 E EM*) - i 1 - 008 

iei Vfe=i 



2nk 

q 



> 2 1 - cos 



2tt 



e fx; /<(*)) • w 

iei \fc=l / 



Similarly, for (0 we have 



'g-l 



v = ££/?(*) +/?(«) 



iei \fc=i 
+ 2 



E fi(k)fS)- cos 

k<l 
k,le{X,...,q-X} 

9-1 

2E^(°)^w- cos 

fcl 
9-1 



27r(fc - 



/2vr£ 



V i 



It follows that 



f * e((eW) 

iei \ \fc=i / 



(i - /,(o)) 2 



2 E/l (,)c O s(-j.(/ i( 0)-l) 



fe=i 



After rearrangement, we obtain 



iei \fc=i / 



(9) 



We substitute the expressions in ^ and (O into (0, and obtain 
that 



d?(p)>(l-cos(27r/ff)) a 



Siei 2 " 2 



(10) 



wei ""i 
where 

9-1 

Mi e I : Xj = /i(fc) . 
fe=l 

Example 2.1: Take !lH = {0, 1} with binary signaling 
over AWGN. In this case, q = 2, and © can be re-written 

as 2 

Z^iei x i 

which accords with the well-known pseudoweight expression 
for the case of binary code and modulation (6). 

Example 2.2: Take D\ = Z3 = {0,1,2} with ternary 
PSK modulation over AWGN. We show that in this case the 
inequality ( fTOb can be slightly improved. Observe that in this 
case, © and (|7]l can be re-written as 



S = 2 J2 (§M1) + hfi ( 2 ) + (1-/<(Q))) 

iei 



iei 



and 



^ = E( 3 ^( 1 )) 2+3 ^( 2 )) 2+3 ^( 1 )^( 2 ), 

iei 

< 3^((/,(l)) + (/,(2))) 2 , (12) 



iei 

where the last equality in ( fTTT i and the equality in ( TT2T > are due 
to the fact that Y^t=o /,•(&) = 1 for all i e T. 

Finally, we substitute the expressions in ( fTTT i and ( fT2b 
into (0 to obtain that 

, 2 



d§(p) > 3 



(E 



iei 



(13) 



iei ^i 



-2^/ l (fc)-cos 



fe=i 



2?rfc 



2/ i (0) + 1 



Example 2.3: Take $H = Z4 = {0,1,2,3} with quater- 
nary PSK (QPSK) modulation over AWGN channel. In this 
case, using ( fTOb , we obtain that 

.j2/ \ ^ (Eiei^O 



^(p) > 



Eiei ^i 



(14) 



where 



(Xi) 



(Ml) +/ i (2)+/ i (3))5 



III. Inequalities for Pseudocodewords 

A complete characterization of the fundamental cone, in 
which the pseudocodewords lie, was given for the case of 
binary coding and modulation in (6). For the present more 
general framework, a complete characterization of the corre- 
sponding fundamental region appears to be a difficult task. 
In this section we derive a set of inequalities which must be 
satisfied by the entries of any pseudocodeword matrix; these 
inequalities must necessarily be satisfied by any pseudocode- 
word lying in the fundamental cone. These inequalities will be 
helpful in deriving the bounds on minimum pseudodistance in 
the sequel. 

Theorem 3.1: Let C be a linear [n, k] code over 91 with 
an m x 7i parity-check matrix TL. Let 1, J and X, be defined 
as in Section ll-Bl Assume that TLj t i is not a zero-divisor in 91 
for any j S J , i G Ij . Let 



V 



be the pseudocodeword matrix of a graph-cover pseudocode- 
word p of the code C with parity-check matrix TL. Then, for 

any j € J, £el 3 ), 



iei-i\{£} bem 



E ^ 



> 



(15) 



Proof: Suppose the graph-cover pseudocodeword p cor- 
responds to the M -cover Q = (V, £), and let C be the linear 
code of length Mn over 9t defined by the parity-check matrix 
TL described by (ffj). Then, Q is the Tanner graph of the code 
C associated with the parity-check matrix TL. 

Take some j & J and £ € Ij. Fix some 1 < j* < M, 
and take the j*-th copy Vjj* E V of the parity-check vertex 
iu € V. Let 



C V 



where 1 < cr(i,j*) < M for every i G X,-. 
Denote j' = (j - 1)M + j*. Since p e C, 

22'Hj<,(i-l)M+<r(i,j*)-Pi,<T(i,j*) = 

This can be rewritten as 



/ **J°,» ' Pi,cr(i,j*) 



. 



Assume that 



<t(*,J*) 



^ 0. Then, 



(16) 



(17) 



and, since TLj.i is not a zero divisor in 9t, the expression 
in ( fTTI ) is non-zero. Therefore, there exists at least one ij* S 
Xj, ij» 7^ £, such that 



The number of indices j* (1 < j* < M) such that 
Pl,v(lj') is given by X^gsr- ""4 ■ This number is 
equal to the number of indices j* (1 < j* < M) such that 
Pi *,a(i ■*,j m ) 0' which, in turn, is less than or equal to 



E(b) 



b^H- 
On division of both sides of ( fl5l > by M, we obtain the 
following result. 

Corollary 3.2: Let C, TL and V be defined as in Theo- 
rem 13.11 Then, for any j G J , i S X, , 

9-1 9-1 

E Em*o > E^w ■ < 18 ) 

i<£lj\{£} fe=l fe=l 



IV. Eigenvalue Bound 

In this section, we consider (c, <i)-regular codes, i.e. the 
parity check matrix TL of C has c nonzero elements per column 
and d nonzero elements per row. Throughout this section, let 
C be a (c, d)-regular linear [n, fc] code over 91 with anmxn 
parity-check matrix TL, and assume that TCj,i is not a zero- 
divisor in D\ for any j e J, i € X, . Let 

= Cfi(fc))i6Z;*e{lA-,9-l} 

be the normalized pseudocodeword matrix of a graph-cover 
pseudocodeword p corresponding to some M-cover of the 
Tanner graph of TL. Denote 



9-1 

Vi el : Xi = fi(k) 

k=l 



and 



a; = (x^ 



We define a real matrix L = TLj ■ TL S , where TL S is an 
m x n matrix whose entries are equal to one on the support 
of TL, and are equal to zero otherwise. We assume that the 
Tanner graph of C corresponding to TL consists of a single 
connected component, and denote by Ai > A2 > • ■ ■ > A n the 
eigenvalues of C. Let v\, v%, ■ ■ ■ , v n be the set of orthonormal 
eigenvectors corresponding to eigenvalues Ai, A2, • • • , A„ of 
the matrix C, respectively. Then, Ai = c • d > A2, and v\ = 
• 1. Also, assume that g-ary PSK modulation is used for 
transmission over the AWGN channel. 

Our analysis follows the lines of J9). 

Lemma 4.1: Let To and x be defined as above. Then, for 
any j € J , we have 



> 2 



E^ 



Proof: For any j e J write \ 1 

2 



n 

2 



\i=l / i=2 



/ n \ 2 / n \ 



> £ 2 -* 2 > 



v i=l 



where the inequality is due to Corollary 13.21 ■ \t=i / \i=i / 

The following lemma is the counterpart of Lemma 8 in J9) ■ as claimed ■ 

The following theorem summarizes the main result in this 



Lemma 4.2: Let a; be a vector defined as in Lemma |4T| SCC ( 10n 
and let y = x ■ H T S . Then, Theorem 4.4: Let C, H, H s and C be defined as above. 



I2/H2 > 2c - 1 1 £K 1 1 2 - Then the minimum pseudodistance with q-ary PSK modulation 



Proof: We write 



2 



over the AWGN channel is bounded from below by 

2c- A 2 



\\y\\l = £ = £ £ *« • " m "" " (1 " cos(27r/9)) " l ' ~ 

We apply Lemma gj] to obtain that ^Proq/: The combination of the results in Lemmas g2j 

13. 



and 14.31 immediately leads to 



(p 1 *) +A2||a;|| 2 - 2c ' H^Hi ' 



llflla > E 2 'E a! * = 2c -iW 

jej" iex, Ai - A 2 

where the last transition is due to the fact that each column n 
in Tt contains exactly c nonzero symbols. ■ 

The following lemma is based on Theorem 10 in 0. and b y rearrangement of the coefficients we obtain 

Lemma 4.3: Let x and y be vectors defined as in %2 
Lemma 02] and let Ai and A 2 be defined as in Section HV] U^jgrgfj > n 2c - A 2 ^ 

Then, IMIi Ai - A2 

. \ / \ 2 By re-writing ( [Tol l, we get 

iiviis<^ £** +^n-ii 2 - ^ ^ ^ 



. 12 

Proof: Write a; as 2c— A 



^ = £ ^i^i 1 



> (1 - cos(2^/g)) 2 • n?—^ , (20) 

Ai — A 2 

where the last transition is due to (1191 . ■ 

where w< (» G Z) are defined in Section El and a 4 (i G I) ^xamp/e 4.7: Consider «R = {0, 1} with binary signaling 

are real numbers In particular over AWGN. In that case, q = 2, and so d20l can be re-written 

/ v as 
1 , . 1 ^ \ w2 . 2c-A 2 



cti = -7= (a;, 1) = -7= E x » I • " min > 2 - \ \ 

Then which coincides with the corresponding bound in (§1, since in 

2 this case d 2 ff 2 (p)/4 = tu e ff(p), the effective Hamming weight 

I I2 = I \ x ' 1 12 = 33 ' £ ' 33 of the pseudocodeword p. 

Example 4.2: Take £R = Z3 with ternary PSK over 
AWGN, as in Example 12.21 In this case, we can combine ([P31 
with ([T9l i. thus obtaining 

E ^ • E ^i ,cr i' v i' f 2c „ A2 
1=1 1=1 «mfa,3 > 6 ■ -F=! 2~ - 371 ' 1 r ' 

/ „ \ 2 n Z^iei^i A i - A2 

E] ^ iCr ^ = — ( E/ ^ ) AjiJ 2 Note that this bound is better then the respective bound which 



E 0- ^ • £ • E 



i' = l 



i=l \i=l / i=2 



follows directly from (|20b . 



Example 4.3: Take = Z 4 with QPSK over AWGN, as 
in Example 12.21 In this case, we can combine (14\ with (fT~9b , 
thus obtaining 



> 



(E 



> n ■ 



2c- A 2 



Eiex^ '" Ai-A 2 

V. Linear-Programming Bound 

In this section, we present the linear-programming lower 
bound on the minimum pseudodistance, similar to its coun- 
terpart in [9, Section 4]. Throughout this section, let C be a 
linear [n, k] code over with an m x n parity-check matrix 
Tt, and assume that 7ij t i is not a zero-divisor in for any 
j e J, i E Tj. Let 

7>0 = (/i(fc))i 6 I;fe e {l,2,...,g-l} 

be the normalized pseudocodeword matrix of a graph-cover 
pseudocodeword p corresponding to some M-cover of the 
Tanner graph of Ti. Denote 

9-1 
k=l 



It follows from Corollary 13.21 that 

^2 Xi>x £ (21) 

for all j e J, t e Tj. The inequalities (ED (for all j e J, 
I £ Tj) can be expressed as 

K,x T > , (22) 

for some JC. 

Let the entries of a vector y 6 R( x > be indexed by (i, i') 6 
X 2 . For i elwe denote by y^ .) and y/. ^ the sub-vectors 
of length n of y consisting of all entries for all i'el 

and of all entries for all i' S X, respectively. 

The following theorem is the main result of this section. It 
is a generalization of Theorem 15 in J9). 

Theorem 5.1: For q-ary PSK modulation over AWGN, 
the minimum pseudodistance d m [ n q is bounded from below 
by 

d 2 ' 

" IV 



j2 > (1 - cos(27r/g)) 2 



mm , q 



max 



kAHv)} ' 



where 



and 



/'(y) = 



y>0, y 1 J =1, 

^Cy^ :) > T for alH e X , 

^yf^.'i) > ° T for all i G X 



Sketch of the proof: We start with the expression in ( fTOl i. 
The expression 



E 



T 2 



can be bounded from below using the same techniques as in 
the proof of Theorem 15 in J9), with respect to x defined as 
above. We omit the details. 
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